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(54) Money validator 

(57) A method of classifying a test article as one of 
a plurality of acceptable denominations of articles of 
currency, comprising applying a statistical classification 
process which employs discriminant surfaces derived 
from previous test articles known to be valid or invalid 



and is arranged to distinguish therebetween, character- 
ised by applying also an acceptance boundary test 
which limits the acceptance volume for each denomina- 
tion so as to exclude forgeries for which the discriminant 
surfaces were not derived. 
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Description 



sands of iterative adjustme^B the network) the net- 
work is found to have adapHT x> the statistics of the 
population of true and false articles to be validated 
which was presented during the training phase, and can 
5 generally perform a non-linear (in measurement space) 
separation between true and false articles which are 
subsequently presented to the network. 

Hitherto, however, neural networks have not been 
applied to banknote recognition. Indeed, there would be 
10 resistance to the use of neural network techniques in 
money validation, because it is difficult to accurately 
characterise the level of performance of the network 
since, due to the non-linear nature of the signal 
processing applied by the network, it is not always clear 
15 how effectively, or in what manner, the network is dis- 
criminating between true and false articles. 

In one aspect, the present invention provides a 
money validator comprising a classifier which classifies 
articles as one of a number of predetermined types of 
20 articles of value utilising classification data comprising 
predetermined coefficients derived from a known train- 
ing set of articles of value to output, at each classifica- 
tion, a plurality of results each corresponding to said 
types, characterised in that, in classifying the measure- 
rs ments of the test article, the classification is performed 
a plurality of times, once for each class of article of 
value to be recognised, and in each case the classifica- 
tion is performed to take account of changes in the sta- 
tistics of the population of one particular class of articles 
30 of value, the statistical classification being utilised to 
confirm or otherwise that the test article corresponds to 
that class. Needless to say, the plural classifications can 
be carried out in sequence or in parallel. 

It might seem surprising that where a plurality of 
35 classification results are calculated for different classes 
by the classifier, this process of calculating classification 
results for a plurality of different classes should be per- 
formed whilst adjusting the classification process for 
one particular class. Nonetheless, from the following, it 
40 will be understood that this leads to a significant 
improvement in the accuracy of the classification. 

In the above aspect, the classifier may comprise a 
neural network; that is to say, it may comprise a classi- 
fier performing a number of parallel calculations (i.e. 
45 calculations on the same input data, whether carried out 
at the same time, or in sequence) utilising predeter- 
mined data derived by iterative modification from test 
articles of value. In this case, the normal method of 
allowing the validator to adapt to changing population 
so statistics would be to continue to train the neural net- 
work in use. However, we have found that this can unde- 
sirably lead towards the network either training on 
forgeries, so as to lower its acceptance rate, or alterna- 
tively if steps are taken to avoid this by training the net- 
55 work only on selected valid articles of value, the network 
becomes unrepresentative and will reject acceptable 
articles of value. Accordingly, we have found it is prefer- 
able to provide a separate adjustment or the change in 
the statistics (e.g. average and/or deviation therefrom) 



This invention relates to a money validator for vali- 
dating articles of value; particularly but not exclusively, 
to a money validator or validating bank notes. 

Money validators are known which comprise sen- 
sors (e.g. a plurality of optical heads) for generating 
sensed signals in response to an article to be validated, 
and decision means (e.g. a microprocessor, microcom- 
puter or LSI circuit) for decided, on the basis of the 
sensed signals, whether the article corresponds to a 
valid denomination or not. Generally, the validation 
process may consist of comparing the sensed signals 
(or values derived therefrom), with predetermined 
thresholds which define acceptable ranges or "win- 
dows" of values, within which signals from a valid article 
are assumed to lie and outside which signals from 
invalid articles are likely to lie. 

It is known to vary the thresholds, and/or the ranges 
or windows, over time to take account of drift, either in 
the response of the sensors, or in the properties of a 
population of articles to be validated; see, for example, 
European patent 155126 and International application 
WO80/01963 (British Patent 2059129), or European 
published Application EP-A-0560023 and correspond- 
ing US Application 08/013708. 

This technology is found to be effective where there 
is a clear limit boundary between a genuine sample 
population and a false sample population. However, this 
is not always the case. Separating the genuine from the 
false population, in the measurement space defined by 
the sensor output signal axes, may require a complex, 
non-linear boundary. 

A pattern recognition technique known in the gen- 
eral field of pattern recognition is the so called "neural 
network" technique. In neural network techniques, sen- 
sor output signals are supplied to a plurality of similar 
parallel processing units, the outputs of which comprise 
some function of their inputs. In practice, the "units" are 
usually not provided by separate hardware, but by a sin- 
gle processor executing sequential processing. 

Neural networks generally operate in two phases. 
In a training phase, the functions applied by each unit 
are derived by an iterative training process comprising 
presenting known genuine and false samples to the net- 
work. In the case of a "supervised" type of network, 
such as the back propagation or perceptron type, the 
outputs of the units are monitored, compared with a 
"correct" network output, and the difference or error 
between the actual network output and the correct out- 
put is propagated back to incrementally affect the func- 
tions applied by each unit to its inputs. Where two or 
more network layers are provided, the function is a non- 
linear (e.g. sigmoidal) function of the weighted sum of 
the inputs, which enables the network to discriminate 
between disjoint patterns, and allows complex non-lin- 
ear pattern separation discriminants. 

After the training phase is complete (and, typically, 
the training phase may require many hundreds of thou- 
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of populations of each class of| 
recognised, so as to align their 
which the classifier was derived. 

In another aspect, the present invention provides a 
banknote recognition apparatus comprising a neural 
network (as above defined) derived using the back 
propagation method, such as a multilayer perceptron 
network. This type of network is found to give a surpris- 
ingly robust performance, and to provide a remarkably 
effective transformation of the input data; for example 
where (as in the below embodiment) the input data 
comprises a very large number (e.g. 270) of optical 
measurements of the test article, it has been found pos- 
sible to achieve recognition using only 12 hidden layer 
nodes within the neural network. Thus, the network has 
effectively transformed a 270 dimensional input meas- 
urement space into a 12 dimensional measurement 
space in which the different classes (e.g. 72 different 
denominations/orientations) are effectively partitioned. 

In another aspect, the present invention consists in 
providing a neural network classifier for a banknote val- 
idator comprising a plurality of different neural networks, 
one for the banknote set of each of a plurality of different 
countries, or one for a group of countries (e.g. Western 
Europe). 

The invention will now be illustrated, by way of 
example only, with reference to the accompanying 
drawings, in which: 

Figure 1 shows schematically the structure of a 
banknote validator with which the present invention 
is suitable for use; 

Figure 2 is a block diagram showing schematically 
the electrical components of a validator according 
to Figure 1 ; 

Figure 3 is a block diagram showing the functional 
elements of a validator according to an embodi- 
ment of the present invention; 
Figure 4, comprising Figure 4a-4d, is a flow dia- 
gram showing schematically the operation of a vali- 
dator according to the embodiment of Figure 3; 
Figure 5 is a block diagram illustratively showing the 
operations performed by a neural network unit 
forming part of the embodiment of Figure 3; 
Figure 6 shows the activation function performed by 
nodes of the neural network of Figure 5; 
Figure 7 is a diagram illustrating, in an exemplary 
two dimensioned pattern space, the operation of 
the embodiment of Figure 3; 
Figure 8 is a block diagram showing in greater 
detail the structure of a statistical adaption unit 
forming part of the embodiment of Figure 3; 
Figure 9 is a flow diagram showing one method of 
deriving the coefficients employed in the embodi- 
ment of Figure 3; and 

Figure 10 is a flow diagram forming part of Figure 9 
and showing illustratively one way of deriving the 
data characterising a neural network unit of the kind 
illustrated in Figure 5. 



Referring to Figure ^^Banknote validator accord- 
ing to one embodiment^Oie invention comprises a 
drive system comprising, for example, a plurality of pairs 
of rollers (for clarity, only one pair of rollers 1a, 1b is 
s shown here) for moving a banknote 5 to be validated 
along a path P1 beneath a plurality of sensors 2a, 2b, 
2c. in this embodiment, the sensors 2a-2c are optical 
colour measurement heads each arranged to detect 
optical amplitude at selected, different wavelengths, 
10 substantially as described in GB 1470737 and/or DE 
2924605. The measurement heads 2a-2c are posi- 
tioned in different lateral positions across the banknote 
5. As the banknote 5 is moved past the measurement 
heads 2a-2c by the drive system 1 , the output signals, 
is for each sensed optical wavelength from the measure- 
ment heads 2a-2c are supplied in a continual sequence 
of samples, to a decision circuit 3 comprising, in this 
embodiment, a microcomputer (for example, one of the 
Motorola 68000 series of microcomputers) comprising 
20 an input circuit, a processing unit, and memory for stor- 
age of programme and constant data and for temporary 
storage of processing results and sensor output data. 

Controlled by the decision circuit 3 is an 
accept/reject gate 4 moveable between a first position, 
25 in which the banknote 5 passes on an accept path P2 
(to, for example, a cash box) and a reject path P3 on 
which the note passes to, for example, an outlet slot for 
returning the note. 

Thus far, the above described apparatus corre- 
30 sponds to known money validators such as, for exam- 
ple, the BSN 385 money validator available from Mars 
Electronics International Inc., (Sodeco Cash Manage- 
ment Systems Division), Geneva Branch, Chemin Pont- 
du-Centenaire 109, CH-1228 Plan-Les-Ouates, Swit- 
35 zerland, and other constructional details of the drive 
system 1, the optical measurement heads 2, the deci- 
sion circuit 3 and the accept/reject gate 4 may be as in 
that apparatus. 

Referring to Figure 2, each of the measurement 
40 heads 2a, 2b, 2c comprises a plurality of light sources 
(e.g. LEDs) 20a, 20b, 20c each generating a different 
optical wavelength (the term "optical" is not limited to 
wavelengths visible to the human eye). The sources 
20a-20c are energised in sequence by a multiplexer 22 
45 to illuminate the banknote 5, and the diffuse reflection 
from the banknote 5 is received by a sensor 21 which 
generates a corresponding output signal indicative of 
the diffuse reflected intensity. The output of the sensor 
21 is sampled in sequence with the multiplexer 22, to 
so provide a train of analogue signal samples which are 
output to the decision circuit 3. Within the decision cir- 
cuit 3, the output of the sensor 21 is received at an ana- 
logue to digital converter 31, which outputs a 
corresponding train of digital signal samples to a demul- 
55 tiplexer 32, which demultiplexes the samples and sup- 
plies the three demultiplexed sensor outputs to 
corresponding buffers 33a-33c. 

The buffers 33a-33c may, for example be contigu- 
ous portions of a single read/write memory. Each buffer 
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33a-33c therefore contains a time ^Bnce of output 
values, corresponding to the diffuse^mected intensity 
from a respective one of the optical wavelengths of the 
LEDs 20a-20c, as the banknote 5 is moved past the 
sensor head 2a. For example, each buffer may contain 
thirty signal values corresponding to a scan of the 
length of a given banknote type. 

The thirty outputs of each buffer (a total of 270 out- 
puts) are supplied to the decision logic 34, which sup- 
plies a banknote identification signal identifying which of 
a plurality of possible valid banknotes has been recog- 
nised for utilisation by the apparatus to which the valida- 
tor is connected (for example, an automatic ticket 
dispensing machine) and a true/false drive signal for 
driving a gate solenoid 4a forming part of the gate 4, to 
select between the accept and reject positions of the 
gate 4. 

Referring to Figure 3, the functional elements pro- 
vided by the decision circuit 3 comprise a thresholding 
unit 35, a flagged candidate buffer 36, a measurement 
correcting unit 37, a neural network classifier unit 38, an 
output logic unit 40, and a statistical adaptation unit 42. 

In use, as described in greater detail below, the 
threshold unit 35 receives the measurements from the 
buffers 33 and subjects them to a relatively coarse test 
which rejects articles which differ greatly from any 
acceptable banknote. Each time the measurements do 
fall within the thresholds associated with a particular 
type of acceptable banknote in a particular type of ori- 
entation, a candidate entry flag is stored in the flagged 
candidate buffer 34 indicating the corresponding type of 
banknote and orientation thereof. 

Next, for each flagged candidate type in the flagged 
candidate buffer 36, a statistical correction is applied to 
the measurements from the buffers 33, to account for 
measurement and population drift, using data stored in 
the statistical adaptation unit 42, a separate correction 
being applied for each candidate in the buffer 36 corre- 
sponding to the drift for that candidate type. 

Then, the corrected measurements are applied to a 
neural network classifier unit 38 in turn. The outputs of 
the neural network classifier 38 comprise one or more 
recognition signals relating to each type of banknote to 
be recognised. 

The output recognition signals from the neural net- 
work unit 38 are combined by the output logic unit 40 to 
provide a signal identifying a particular type of recog- 
nised banknote, or a signal rejecting the banknote and 
actuating the gate 4. 

In the event that a particular type of banknote is rec- 
ognised, the statistics held in the statistical adaptation 
unit 42 are updated to reflect the measurements held in 
the buffer 33 for the just accepted banknote. 

Referring to Figure 4, the operation of the decision 
circuit 3 will not be discussed in greater detail. 

Threshold Unit 35 

Figure 4a indicates the operation of the decision cir- 
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cuit 3 in providing the thresl^^^cuit 35. The threshold 
circuit 35 makes use of statisRl data held in the statis- 
tical adaptation circuit 42. The statistical adaptation unit 
holds, for each note to be recognised (for example 
5 eighteen notes), in each orientation (typically, four ori- 
entations) a mean and a standard deviation value m, n ; 
oj n ; where I is the index of the banknote and orientation 
type (1=1 to L (e.g. 72)) and n is the index of the meas- 
urement (n=1 to N, where N is the total number of 
10 measurements (e.g. 270)). 

For each measurement, the error between the 
measurement and the corresponding value stored for a 
given candidate is calculated as follows: 

® In 

If this error is greater than a predetermined thresh- 
20 old Q, an error score E (initialised at zero) is incre- 
mented; if it is equal to or less than the threshold the 
error score E is not incremented. The threshold Q may 
conveniently be the same for all measurements, for a 
given candidate note/orientation. Typically, the thresh- 
es old Q is set at around 4 (corresponding to 4 standard 
deviations) for the measurement concerned. 

TTius, when all measurements have been thresh- 
olded, the incremented total E corresponds to the 
number of occasions on which individual measure- 
30 ments have exceeded the respective threshold for the 
candidate. This total E is then compared with a thresh- 
old T,, and if the error does not exceed the threshold 
then a flag corresponding to the candidate is stored in 
the flagged candidate buffer 36. If the threshold T| is 
35 exceeded, then the candidate is not stored in the 
flagged candidate buffer. The threshold T for each can- 
didate is selected to be relatively wide, so that substan- 
tially all valid banknotes of the type and orientation 
concerned will be accepted, regardless of whether 
40 some confusably similar banknotes or forgeries would 
also be accepted. 

The process is repeated for each of the L candi- 
dates. After this, if there are no flagged candidates in 
the flagged candidate buffer 36, the banknote is not 
45 even remotely similar to any of the acceptable denomi- 
nations, and the control unit 3 actuates the reject gate 4 
to reject the banknote, as shown in Figure 4c. 

Values for Q and T for the various denomination/ori- 
entations are stored in memory provided in the thresh- 
so old unit 35. 

Correction Unit 37 

Referring to Figure 4b, when functioning as the cor- 
55 rection unit 36 the decision circuit 3 is arranged, for 
each of the candidate note/orientations indicated by the 
contents of the flagged candidate buffer 34, to read the 
measurement values from the buffer 33 and to correct 
each for the effects of drift by dividing by the running 
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average (7r? /n ) relevant to that <^^Aate I supplied by 
the statistical adaptation unit 42.^^ 

The magnitude of the measurements are aligned 
with those for which the neural network unit 38 was 
trained by multiplying each measurement by the mean 
value (mf n ) , of the measurement in question, which 
was encountered in the banknotes used to train the 
neural network unit 38 for that candidate I. Thus, for 
each measurement, a corrected measurement m' n is 
calculated as follows: 



m 



Neural Network Unit 38 

Referring to Figure 5, the schematic structure of the 
neural network unit 38 is illustrated. The corrected 
measurements mym' n are each supplied to each or a 
plurality of hidden layer nodes 381 a-381 i (in this embod- 
iment, twelve such hidden layer nodes 381 are 
employed), and the outputs of each of the hidden layer 
nodes 381 a-381 i are each supplied to each of two L out- 
put layer nodes (two output layer nodes for each note to 
be recognised in each orientation). Output layer nodes 
382a-382f are illustrated here. 

For each of the L note/orientation combinations, a 
first output layer node (for example 382a) generates an 
output signal the value of which indicates whether the 
tested note is recognised as corresponding to that can- 
didate or not, and a second output layer node (for exam- 
ple 382b) generates an output signal indicating whether 
the tested note corresponds to a known forgery for that 
type of candidate or not. 

The weights W of the output nodes are generated in 
the training phase such that the outputs of the output 
nodes 382 are saturated (i.e. either high or low). 

In this embodiment, the neural network unit 38 pro- 
vides a multilayer perceptron or back propagation type 
network (known of itself), in which the output Y of each 
node is given by: 



y,=S(£W,yXy) 



/-1 



where X represents the vector of inputs to the node, and 
Wy is a corresponding vector of predetermined weight- 
ing coefficients derived during the training phase and 
stored by the neural network unit 38. As shown in Figure 
5, one of the inputs to each node maybe a constant (e.g. 
H as shown); the other inputs are, in the case of the hid- 
den layer nodes 381a, the vector of measurements my 
m' n and, in the case of the output layer nodes 382, the 
vector of outputs of the hidden layer nodes 381 . 

The function S is a non-linear function which acts to 



compress the range of Sde output signal; prefera- 
bly it has a generally sigroidal shape as illustrated in 
Figure 6. In this embodiment, it is given by a hyperbolic 
tangent: 



S(U): 



(e u -e«) 



10 In this embodiment, the neural network unit 38 may 
store multiple neural networks of the type shown in Fig- 
ure 5; one neural network being provided for the note 
set of each country in which the validator might be used, 
and the neural network unit being operable to selec- 

15 tively employ only one of the neural networks. 

It will readily be seen that the hidden layer nodes 
381 and output layer nodes 382 need not be provided 
by separate processors but could be (and in this embod- 
iment are) provided by a microcomputer circuit arranged 

20 to calculate and store the output of each hidden layer 
node in turn, and then use these to calculate the output 
of each output layer in turn, in accordance with the 
above relationships. 

The weight values W for each node 381 a-381 c, 

25 382a-382f of the hidden layer and the output layer are 
accordingly stored in memory provided within the neural 
network unit 38, and thus effectively characterise the 
network. 

30 Operation of the Neural Network Unit 38 

Referring to Figure 4b, for each candidate I in the 
flagged candidate buffer 36, the correction unit 37 reads 
the running average (m t n ) and the average of the train- 

35 ing data rri| n for each measurement value held in the 
buffer 33, and calculates corrected measurements m' n 
as discussed above. These corrected measurements 
are then employed as inputs to the neural network unit 
38, which calculates output values for each of the two L 

40 outputs nodes 382a-382f. The output values are then 
temporarily retained. Next, the correction unit proceeds 
to the next candidate in the flagged candidate buffer 36, 
reads the running average and training data averages 
from the statistical adaptation unit, reads once more the 

45 measurements from the buffer 33, and calculates a new 
set of corrected measurements, corrected for the drift 
which would be encountered for that candidate. This 
corrected set of measurements m' n are then presented 
to the neural network unit 38 which once more calcu- 

50 lates the outputs of the output layer nodes 382a-382f, 
and once more buffers these. 

This process is repeated for each of the candidates 
in the flagged candidate buffer 36. 

This process is then repeated for each of the candi- 

55 dates in the flagged candidate buffer 36. 

Output Logic Unit 40 

The output logic unit 40 receives the 2L outputs of 
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the neural network unit 38 for each candidates in 
the flagged candidate buffer. On the ^ffs of these out- 
put node outputs, the output logic unit 40 generates 
either a recognition output indicating recognition of one 
of the valid banknotes, or a signal indicating that no 5 
valid banknote has been recognised (to operate the 
reject gate 4). 

For each of the possible candidates in the flagged 
candidate buffer 36, the outputs of the output nodes 382 
may be in one of several conditions: 10 

1 . The "true" output node for the candidate being 
considered may be the only output node which is 
generating a positive output signal. 

2. A different output node may be generating a pos- 15 
itive output signal. 

3. Several output nodes may be generating a posi- 
tive output signal. 

4. One of the "false" output nodes may be generat- 
ing a positive output signal, indicating recognition of 20 
a forgery. 

5. No output node may be generating a high output 
signal (in which case, the document is completely 
unknown to a neural network 38). 

25 

In all cases other than the first of the above, the out- 
put logic unit 40 generates a signal to reject the tested 
note. Thus, a note is rejected even if there is confusion 
as to its identity (indicated by several outputs being 
high) or its identity is false (indicated by a high output 30 
other than at the output node which corresponds to the 
candidate in question for which the input measurements 
were corrected). 

Furthermore, the note is also rejected if confusion 
has arisen because a single (apparently correct) high 35 
output signal has been generated for more than one of 
the candidates in the flagged candidate buffer 36; that is 
to say when correcting the data for a first flagged candi- 
date gives rise to an apparently correct result but so 
does correcting the data for a second flagged candi- 40 
date. 

In the case where there is no confusion, either 
between different output nodes for the same corrected 
input data or for network outputs for differently corrected 
data, the single correct output node output signal identi- 45 
fies the note value and orientation, which are output by 
the output logic unit for use by the automatic machinery 
with which the validator is to be used. 
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Effect of the Threshold Unit 35 



so 



Referring to Figure 7, in a two dimensional illustra- 
tion of a measurement space, the measurement values 
or genuine notes of a first denomination are clustered in 
a group N1 ; those for a second denomination in a group ss 
N2 and those for a third denomination in a group N3. A 
forgery of notes of the first type is shown clustered as 
F1; two forgeries for a note of the second type are 
shown as clusters F2; and a forgery for a note of the 



third type is shown as a clu^ 

The boundaries corresponding to the transition 
between different output nodes 382a-382f are shown as 
thin lines A. It will be seen that the neural network unit 
38 has found lines or surfaces which can effectively dis- 
criminate between each genuine note and the known 
forgeries. However, these separation planes leave a 
large volume of space (for example the space above the 
cluster N1 or that to the left of the cluster N3) unparti- 
tioned, because no forgeries having measurements cor- 
responding to these regions were present in the data on 
which the neural network was trained. Accordingly, 
although the neural network unit 38 is accurate in dis- 
criminating between different types of genuine note, and 
between genuine notes and known forgeries, it gives a 
poor, or at best, an unknown performance against new 
types of forgeries having measurements falling in such 
volumes of space. 

Referring once more to Figure 7, however, the 
threshold unit 35 acts to apply a relatively wide accept- 
ance threshold around each genuine banknote cluster 
N1 , N2, N3, and thus effectively limits the volume in the 
measurement space within which test articles will be 
accepted as corresponding to each of those banknote 
classes. Accordingly, although the threshold unit 35 is 
completely ineffective in discriminating between the 
banknotes N1 and N2 and their known forgeries F1 and 
F2, it offers a considerable measure of protection of the 
validator against unknown forgeries whereas the neural 
network unit 38 provides a much more accurate discrim- 
ination against known forgeries. 

Statistical Adaptation Unit 42 

Referring to Figure 8, the statistical adaptation unit 
42 comprises a read/write store 421 (e.g. an area of 
RAM) and an arithmetic processing unit 422 arranged to 
read and write to the store 421, and to perform prede- 
termined statistical processing on the contents thereof. 

As shown in Figure 8, the store 421 stores N x L 
records (where N is the number of measurements and L 
is the number of denominations/orientation candidate 
notes). Each record comprises three numerical values; 
a running average (7f? /n ) a running deviation a, n , and a 
training set mean m^. The last of these is a constant, 
the value of which is not altered by the processor 422. 

When the output logic unit 40 indicates, as 
described above, that a valid note of a particular 
denomination in a particular orientation has been recog- 
nised, the candidate number I of the note is supplied to 
the statistical processor 422. The statistical processor 
422 then reads each of the N running average and devi- 
ation values in the table 421 relevant to that candidate I 
and calculates an updated average and deviation value 
utilising the existing value and the corresponding meas- 
urement value read from the buffer 33. The updated 
value is then stored in the store 421 for subsequent use. 

In this embodiment, the running average (m, n ) is a 
running mean, and the deviation v\ n is the standard 
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deviation. Accordingly, in this ei 
cal processor 422 is arranged 
mean value as 



_ 1 P^m+m 

m - 
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ent, the statisti- 
Iculate the new 



P l+ 1 



and the standard deviation as 



1 

a =- 



\m-m k 



P 2 +1 



The values of the parameters P 2 determine the 
influence of each new measurement on the running 
average and deviation, and are therefore relatively large 
in practice. The values P-| P 2 may, in another embodi- 
ment, be functions of the number of times the stored 
values have been adjusted; in this case, for each candi- 
date a count is incremented each time an adjustment is 
made to the mean and deviation values for that candi- 
date and the Pi P 2 values are determined in accord- 
ance on the count (for example by a linear relationship 
Pj = Aj + Bj.count). 

Thus, each time a banknote is accepted, the aver- 
age (and in this embodiment, the deviation) of the 
measurements found for the recognised class of ban- 
knote are updated to take account of drift of the charac- 
teristics of the banknote or the validator. 

Training the Neural Network 38 

Although it is not necessary for an appreciation of 
the operation of the invention, a brief description of the 
method of training the neural network unit 38 so as to 
derive suitable values for the weighting coefficients W, 
will now be disclosed. Specific details of the method in 
so far as it applies to back propagation MLP networks 
as described in the above embodiments, are well known 
to the skilled person and are described, for example in: 

Rumelhart D E, Hinton G E and Williams R J: 
'Learning internal representation by error propaga- 
tion', in 'Parallel Distributed Processing :Explora- 
tions in the Microstructures of Cognition*, eds 
Rumelhart and McClelland, 1 Foundations, pp 
318-362, MIT Press (1986) (incorporated herein by 
reference), 



or in 



"Introduction aux r6seaux de neurones" 
F. Blayo 

Cours du d6partement d'informatique, laboratoire 
de microinformatique EPFL. 
pp. 52-58 

Lausanne, 25 mars 1991, or 
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ntissage pour r6seau & 



"Une proc6dure d< 
seuil asym&trique" 
Y Le Cun 

Actes de COGNITIVA 85, pp. 599-604 
Paris, juin 1985, or (in general terms) in 

"Adaptive Switching Circuits" 
B. Window, M.E. Hoff 

1960 IRE WESCON Convention Record, New- 
York: IRE, pp. 96-104, 1960. 



A measurement system similar to (but not neces- 
sarily implemented by) the measurement heads 2a, 2b, 
2c measures the sensor values from a plurality of ban- 
15 knotes comprising a training set. The training set com- 
prises subsets of each banknote in each orientation, 
and of all known forgeries (if any) for each note/orienta- 
tion. 

Referring to Figure 9, each subset of the training 

20 set is randomly selected to comprise, for example, 10% 
of a larger available population of banknotes. 

Next, the neural network is trained as shown in Fig- 
ure 10 (i.e. the values of the weighting constants are 
derived) by initially selecting a random set of weighting 

25 constant values; then calculating, using these weighting 
constant values, what the outputs of the hidden layer 
381a-381i and output neurons 382a-382f would be; 
then comparing these outputs with the "correct" outputs 
for the first node (i.e. +1 for the output node 382a-382f 

30 corresponding to the identity of the note, and -1 for all 
other output nodes); and then adjusting the weights of 
each output layer node and hidden layer node using the 
back propagation method to incrementally shift the cal- 
culated outputs corresponding to the output layer nodes 

35 towards the "true" values. 

This is then repeated for each node of the training 
set, in random order, and the process is iterated until the 
outputs calculated to correspond to the output layer 
nodes give a very high rejection rate (i.e. closely 

40 approximating 100%) for forgeries, and a high accept- 
ance rate (i.e. above 97%) for all genuine banknote 
denominations/orientations. 

If the weighting values give rise to output node out- 
put values which meet these criteria, the weighting val- 

45 ues are considered to have successfully characterised 
the neural network (i.e. the neural network has been 
trained successfully), and the weighting values are 
stored. 

Returning to Figure 9, the next step is to use all the 
so measurement values for all the notes of each subset to 
calculate the training data mean and the initial value of 
the standard deviation, to be stored in the table 421. 
The value of the running mean is, at this stage, set to 
the same value as the training set mean. 
55 Next, the thresholds Q utilised by the threshold unit 
35 are set for example at 4ct, in other words 4 times the 
standard deviation for each measurement derived from 
the training data. 

The error score total T is then calculated so as to 
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:e denomina- 



obtain 100% acceptance of all the 
tions/orientations in the set. 

Finally, the performance of the validator is emulated 
using the neural network weighting coefficients; the 
thresholds Q; means, standard deviations and global s 
error T calculated as above, and if all correct notes are 
accepted and all forgeries are rejected, the values thus 
calculated are taken to be sufficiently accurate. If this 
test is not met, another training set of notes is selected 
in the process of Figure 9 is begun again. w 

When an accepted set of weight coefficients W 
thresholds Q and so on have been found, they are 
stored in the store 41 , the threshold unit 35 and the neu- 
ral network unit 38 of an unprogrammed validator which 
is otherwise as described above, and which is then is 
ready for use. 

It will be clear that the above described process 
may be performed on computing apparatus of any suit- 
able kind arranged to receive measurement signals or 
previously stored data corresponding to measurement 20 
signals, from banknotes. As a validator itself comprises 
a measurement unit together with, in some embodi- 
ments, a microprocessor, the validator may be pro- 
grammed to perform the training process just described 
itself prior to use in validation, but the manner in which 25 
the data characterising the validator whilst validating is 
derived is not relevant to the operation of the validator 
whilst validating. 



Other Embodiments 



30 



In a further embodiment, the structure of the neural 
network shown in Figure 5 is simplified so that the 
true/false output nodes 382b, 382d, 382f are omitted 
and only a single output node for each denomina- 35 
tion/orientation is present. This reduces the volume of 
calculation to be performed by the network. 

Although in the above description the mean and 
standard deviation are discussed, it would equally be 
possible to employ different measures of the running 40 
average and variability of the data; for example by main- 
taining a tracking median and/or a measure based on 
the sum of differences from the running average. In 
some embodiments, it may be possible merely to adapt 
either the running average or the measure of variability, 45 
but not both. 

Although in the above described embodiments, the 
threshold unit 35 applies a coarse test comprising 
applying a plurality of thresholds and then counting the 
number of deviations from the thresholds, other coarse so 
acceptance tests are also possible; for instance, deriv- 
ing a "city block" distance metric or a Mahalanobis dis- 
tance metric. However, in some aspects it is preferred to 
utilise coarse tests which share with the above 
described embodiment the feature of accepting, in a ss 
large number of measurements, a small number of devi- 
ations from acceptable limits due to (for example) a 
small damaged area of a note. 

In the foregoing, the "neural network" when used to 



validate will be understood t^Bprise apparatus which 
calculates, utilising predeterBed weighting values, a 
number of outputs from input data as described above, 
whether or not such calculations are performed in paral- 
lel and regardless of whether they are performed by 
dedicated hardware or a general purpose calculating 
device suitably programmed. The weighting values, as 
described above, are found iteratively from training 
data. 

In another embodiment, the validator itself is 
arranged to perform the above training operations, or 
example to allow learning of new banknote types in the 
field. 

Although in the above described embodiments, 
each measurement is normalised prior to application to 
the neural network, it will be understood that the same 
effect could be achieved by temporarily normalising the 
coefficient values of the input nodes 381 of the neural 
network, and this is equally within the scope of the 
invention. Equally, throughout the foregoing description, 
the skilled reader will understand that (except at nonlin- 
ear stages of the process) the associative and distribu- 
tive laws of arithmetic are applicable so that operations 
may be performed in other orders or manners than 
those described above, to achieve the same effect. 

Although LED's have been mentioned, it will be 
dear that other types of optical emitter could be 
employed, operating in the visible or invisible spectra. 
Equally, magnetic or other sensors could be employed 
instead. 

Further, other types of nonlinear function could eas- 
ily be employed; for example; a Radial Basis function, or 
a sigmoid function S(u) = 1/(1 + e " u ) . 

Accordingly, many other modifications may be 
made to the preceding invention without departing from 
its scope and nature. 

Claims 

1 . A method of classifying a test article as one of a 
plurality of acceptable denominations of articles of 
currency, comprising applying a classification proc- 
ess employing stored reference data which has pre- 
viously been derived from training articles known to 
be valid or invalid examples of said denominations 
and is arranged to distinguish therebetween, char- 
acterised in that level data relating to the range or 
average level of measurement values derived from 
said training articles is stored, for each of said 
denominations, and in that measurements derived 
from test articles are processed using said stored 
level data to align them with each said stored range 
for each denomination during said classification 
process. 

2. A method according to claim 1 , in which said level 
data is stored as an average value for each said 
denomination. 
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3. A method according to clairj^B claim 2 in which 
said processing comprise^Wming, for each 
denomination, a correction factor responsive to the 
ratio between said level data and a running average 
of said measurements. 

4. A method according to any preceding claim charac- 
terised by applying also an acceptance boundary 
test which limits the acceptance volume for each 
denomination so as to exclude forgeries not corre- 
sponding to training articles from which said proc- 
ess was derived. 

5. A method according to claim 4 in which the accept- 
ance boundary test comprises 

applying, for each acceptable denomination, 
relatively relaxed acceptance criteria so as to 
reject those denominations for which said 
relaxed acceptance criteria are not met prior to 
applying said acceptance process. 

6. A method according to any preceding claim in 
which the acceptance process comprises forming, 
for each acceptable denomination, a linear function 
of said measurement signals; and applying a con- 
tinuous non-linear function to the result of said lin- 
ear function. 

7. A method according to any preceding claim, in 
which the acceptance process comprises a neural 
network process. 

8. A method according to claim 7 in which the neural 
network process comprises a feed-forward proc- 
ess, the constants characterising the process hav- 
ing been iteratively derived in a training phase by 
back propagation. 

9. A method according to claim 7 or claim 8 in which 
the neural network process comprises two network 
layers. 

10. A method according to claim 9 in which the hidden 
layer of said neural network comprises substantially 
fewer (e.g. an order of magnitude less) nodes than 
the inputs thereto. 

11 . A money validator arranged to operate the method 
of any preceding claim. 

12. A validator for banknotes which comprises a feed 
forward neural network calculating means, the data 
characterising said neural network having been 
derived by an iterative error back propagation proc- 
ess. 

13. A validator according to claim 11 or claim 12 in 
which the neural network receives measurement 
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14. A method of classifying a test article as one of a 
plurality of acceptable denominations of articles of 
currency, comprising: 

deriving a plurality of measurement signals 
from a test article; and 

applying an acceptance process to said meas- 
urement signals, said acceptance process cal- 
culating first, second and third outputs 
indicating correspondence with first, second 
and third denominations, characterised in that 
for each said test item said acceptance proc- 
ess is performed a plurality of times, differently 
adjusted to compensate for the effects of 
measurement drift for at least said first, second 
and third denominations at each performance, 
and in that in each performance of said accept- 
ance process, an output corresponding to the 
denomination for which the acceptance proc- 
ess is adjusted is calculated, and at least two 
other outputs for two different denominations 
are also calculated. 

15. A method according to claim 14 in which said 
acceptance process is performed said plurality of 
times in succession. 



16. A method according to claim 14 or claim 15 in which 
said acceptance process is adjusted by processing 
said measurements using, for each denomination, 
stored drift data, to produce corrected measure- 

35 ments for each denomination, and applying a com- 
mon acceptance process to said corrected 
measurements. 

17. A method or validator according to any preceding 
40 claim employing optical sensing of the banknote or 

article of value. 

18. A method or validator according to claim 17 in 
which the optical sensing is performed at a plurality 

45 of different wavel engths. 

19. A money validator for classifying a test article as 
one of a plurality of acceptable denominations of 
articles of currency, comprising sensor means for 

50 deriving a plurality of measurements from said test 
article; non-linear discriminant means for deriving a 
plurality of different linear combinations of said 
measurements and then applying, to each, a 
respective non-linear compression function (e.g. a 

55 sigmoid), to generate a plurality of non-linear output 
signals; and decision means for rejecting a test arti- 
cle or accepting said test article as one of said plu- 
rality of denominations, based on said non-linear 
outputs. 
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20. A validator according to claim ^H| ther compris- 
ing adjustment means for applyi^^ff plurality of dif- 
ferent adjustments, corresponding to said plurality 
of denominations, to said measurements to pro- 
duce a plurality of sets of adjusted measurements, 5 
each of which is separately supplied to said means 
for producing a plurality of linear combinations. 

21 . A validator according to claim 1 9 or claim 20 further 
comprising means for applying an acceptance 10 
boundary test which limits the volume of the accept- 
ance region in measurement space which would 
otherwise be applied by said validator. 
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